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A^— body phase space with the given total energy. Due to Boltzmann's principle, 
e s = tr(S(E — H)), its geometrical size is related to the entropy S(E,N, ■ ■ •). This 
definition does not invoke any information theory, no thermodynamic limit, no ex- 
tensivity, and no homogeneity assumption, as are needed in conventional (canonical) 



Abstract: Equilibrium statistics of Hamiltonian systems is correctly described by 
the microcanonical ensemble. Classically this is the manifold of all points in the 



thermo-statistics. Therefore, it describes the equilibrium statistics of extensive as well 
^ ! of non-extensive systems. Due to this fact it is the fundamental definition of any clas- 

sical equilibrium statistics. It can address nuclei and astrophysical objects as well. All 
kind of phase transitions can be distinguished sharply and uniquely for even small sys- 
tems. It is further shown that the second law is a natural consequence of the statistical 
nature of thermodynamics which describes all systems with the same - redundant - set 
of few control parameters simultaneously. It has nothing to do with the thermodynamic 



limit. It even works in systems which are by far larger than any thermodynamic "limit" . 



Keywords: Classical Thermo-statistics, Non-extensive systems. 
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1 Introduction 

Classical thermodynamics and the theory of phase transitions of homogeneous and large systems 
are some of the oldest and best established theories in physics. It may look strange to add anything 
new to it. Let me recapitulate what was told to us since > 100 years and still told today c.f. PP : 

• thermodynamics addresses large homogeneous systems at equilibrium (in the thermody- 
namic limit N -> OQ\ N /v=p,homogeneous)- 

• Phase transitions are the positive zeros of the grand-canonical partition sum Z(T,fi,V) as 
function of e^ 1 (Yang-Lee-singularities). As the partition sum for a finite number of particles 
is always positive, zeros can only exist in the thermodynamic limit V\p^ — > oo. 

• Micro and canonical ensembles are equivalent. 1 

• thermodynamics works with intensive variables T, P, \i. 

• Unique Legendre mapping T — > E. 

• Heat only flows from hot to cold (Clausius) 

• Second law only in infinite systems when the Poincarre recurrence time becomes infinite 
(much larger than the age of the universe (Boltzmann)). 

Under these constraint only a tiny part of the real world of equilibrium systems can be treated. 
The ubiquitous non-homogeneous systems: nuclei, clusters, polymers, soft matter (biological) sys- 
tems, but also the largest, astrophysical systems are not covered. Even normal systems with 
short-range coupling at phase separations are non-homogeneous and can only be treated within 

1 How does one normally prove this?: The general link between the microcanonical probability e s ( E ' N ^ and the 
grand-canonical partition function Z(T, (i) for extensive systems is by the Laplace transform: 
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If s(e, n) is concave then there is a single point e s ,n s with 
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In the thermodynamic limit (V — » oo) the quadratic approximation in equ.J3J) becomes exact and there is a one to 
one mapping of the microscopic mechanical e = E/V, n = N/V to the intensive T, \i. 
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conventional homogeneous thermodynamics (e.g. van-der-Waals theory) by bridging the unstable 
region of negative compressibility by an artificial Maxwell construction. Thus even the original 
goal, for which thermodynamics was invented some 150 years ago, the description of steam en- 
gines is only artificially solved. There is no (grand-) canonical ensemble of phase separated and, 
consequently, non-homogeneous, configurations. It has a deep reason as I will discuss below: here 
the systems have a negative heat capacity C (resp. susceptibility). This, however, is impossible 
in the (grand-) canonical theory where C oc {SE) 2 

In this paper I will describe a generalization which takes Boltzmann's principle serious and 
avoids the thermodynamic limit. This opens thermodynamics to the much larger world of non- 
extensive systems. The most prominent example are of course self-gravitating astrophysical sys- 
tems which I will discuss here also. All the so familiar paradigms above have an only limited 
validity and are clearly violated at the most interesting situations as shown below. 

Moreover, it helps to clarify the physical background of the statistical approach: The incom- 
pleteness of our knowledge of the degrees of freedom leads to the various ensembles and to their 
characteristic differences. Thermodynamics describes the properties of the entire ensemble not of 
a specific system (point in phase-space). Further, it will clarify the importance and origin of the 
fluctuations. It will shed new light on the microscopic mechanism leading to first order phase 
transitions. Finally, it will illuminate the origin of irreversibility and the second law out of the 
time-reversible microscopic equations of motion. 

2 Boltzmann's principle 

The Microcanonical ensemble is the ensemble (manifold) of all possible points in the 6N dimen- 
sional phase space at the prescribed sharp energy E: 



thermodynamics addresses the whole ensemble. It is ruled by the topology of the geometrical size 
W(E, N, ■ ■ •), Boltzmann's principle: 



is the most fundamental definition of the entropy S. Entropy and with it micro-canonical ther- 
modynamics has therefore a pure mechanical, geometrical foundation. No information theoretical 
formulation is needed. Moreover, in contrast to the canonical entropy, S(E,N,..) is everywhere 
single valued and multiple differentiable. There is no need for extensivity, no need of concavity, 
no need of additivity, and no need of the thermodynamic limit. This is a great advantage of the 
geometric foundation of equilibrium statistics over the conventional definition by the Boltzmann- 
Gibbs canonical theory. However, addressing entropy to finite eventually small systems we will 
face a new problem with Zermelo's objection against the monotonic rise of entropy, the second law, 
when the system approaches its equilibrium. This is discussed in section (jHJ c.f.[2JIHj. A further 
comment: In contrast to many authors like Schrodinger |I] our ensemble is not an ensemble of 




(4) 
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S=k*lnW 
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non-interacting replica of the considered system which may exchange energy. I do not consider the 
different ways to distribute energy over the different replica. I consider the manifold of the same 
system at the precisely given energy under all possible different distributions of the momenta and 
positions of its constituents (particles) in the 6iV-dimensional phase space. The result is then the 
average behaviour when one does not know the precise position and momentum of every particle 
but only the total energy. 



3 Topological properties of S(E, 



The topology of the Hessian of S(E,---), the determinant of curvature of s(e,n) determines 
completely all kinds phase transitions. This is evidently so, because e s ^~ E ^ T is the weight of 
each energy in the canonical partition sum at given T, see footnote Q Consequently, at phase 
separation this has at least two maxima, the two phases. And in between two maxima there must 
be a minimum where the curvature of S(E) is positive. I.e. the positive curvature detects phase 
separation. This is also in the case of several conserved control parameters. 
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Of course for a finite system each of these maxima of S(E, 
There are intrinsic fluctuations in each phase. 



— E/T have a non- vanishing width. 



3.1 Unambiguous signal of phase transitions in a "Small" system 

The whole zoo of phase-transitions can be sharply seen and distinguished. This is here demon- 
strated for the Potts-gas model on a two dimensional lattice of finite size of 50 x 50 lattice points, 
c.f. fig.©. 

3.2 Systematic of phase transitions in the micro-canonical ensemble without invoking the ther- 
modynamic limit 

• A single stable phase of course with some intrinsic fluctuations (width) by a negative largest 
curvature Ai < 0. Here s(e,n) is concave (downwards bending) in both directions. Then 
there is a one to one mapping of the canonical <->the micro-ensemble. 
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A transition of first order with phase separation and surface tension is indicated by Ai(e, n) > 
0. s(e, n) has a convex intruder (upwards bending) in the direction vi of the largest curvature 
> which can be identified with the order parameter jjj. Three solutions of 
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determine the intensive temperature T = 1/(3 and the chemical potential Tv. 




_I Os 03_ 

order parameter 



In the thermodynamic limit the whole region {01,03} is mapped into a single point in the 
canonical ensemble which is consequently non-local in o. I.e. if the curvature of S(E, N) is 
Ai > both ensembles are not equivalent even in the limit. 

• A continuous ("second order") transition with vanishing surface tension, where two neigh- 
boring phases become indistinguishable. This is indicated in figure (JTJ) by a line with Ai = 
and extremum of Ai in the direction of order parameter va=o • VAi = 0. These are the 
catastrophes of the Laplace transform E —>■ T. 
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3.3 CURVATURE 

We saw that the curvature (Hessian) of S(E, N, ■ ■ •) controls the phase transitions. What is the 
physics behind the curvature? For short-range force it is linked to the interphase surface tension. 

Table 1: Parameters of the liquid-gas transition of small sodium clusters (MMMC-calculation [7j) 
in comparison with the bulk for a rising number Nq of atoms, N sur f is the average number of surface 
atoms (estimated here as J2 ^duster) °f a ^ dusters with iVj > 2 together. a/T tr = As sur f*N /N sur f 
corresponds to the surface tension. Its bulk value is adjusted to agree with the experimental values 
of the a s parameter which we used in the liquid-drop formula for the binding energies of small 
clusters, c.f. Brechignac et al. [H], and which are used in this calculation [7j for the individual 
clusters. 
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Figure 1: Global phase diagram or contour plot of the curvature determinant (Hessian), eqn. (jZJ), 
of the 2-dim Potts-3 lattice gas with 50 * 50 lattice points, n is the number of particles per 
lattice point, e is the total energy per lattice point. The line (-2,1) to (0,0) is the ground-state 
energy of the lattice-gas as function of n. The most right curve is the locus of configurations with 
completely random spin-orientations (maximum entropy). The whole physics of the model plays 
between these two boundaries. At the dark-gray lines the Hessian is det = 0,this is the boundary 
of the region of phase separation (the triangle AP m B) with a negative Hessian (Ai > 0, A 2 < 0). 
Here, we have Pseudo-Riemannian geometry. At the light-gray lines is a minimum of det(e,n) in 
the direction of the largest curvature (v Ama:c -Vdet = 0) and det = 0, these are lines of second order 
transition. In the triangle AP m C is the pure ordered (solid) phase (det > 0, Ai < 0). Above and 
right of the line CP m B is the pure disordered (gas) phase (det > 0, Ai < 0). The crossing P m of 
the boundary lines is a multi-critical point. It is also the critical end-point of the region of phase 
separation (det < 0, Ai > 0, A 2 < 0). The light-gray region around the multi-critical point P m 
corresponds to a flat, horizontal region of det(e, n) ~ and consequently to a somewhat extended 
cylindrical region of s(e, n) and VAi~ 0, details see 0111; C is the analytically known position 
of the critical point which the ordinary q = 3 Potts model (without vacancies) would have in the 
thermodynamic limit 
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Figure 2: MMMC [7] simulation of the entropy s(e) per atom (e in eV per atom) of a system of 
iVo = 1000 sodium atoms at an external pressure of 1 atm. At the energy e < e± the system is in the 
pure liquid phase and at e > e 3 in the pure gas phase, of course with fluctuations. The latent heat 
per atom is q\ a t = e% — e±. Attention: the curve s(e) is artificially sheared by subtracting a linear 
function 25 + e*11.5 in order to make the convex intruder visible. s(e) is always a steep monotonic 
rising function. We clearly see the global concave (downwards bending) nature of s(e) and its 
convex intruder. Its depth is the entropy loss due to additional correlations by the interfaces. It 
scales oc iV" 1 / 3 . From this one can calculate the surface tension per surface atom a sur f/T tr = 
As sur f * N /N sur f. The double tangent (Gibbs construction) is the concave hull of s(e). Its 
derivative gives the Maxwell line in the caloric curve T(e) at T tr . In the thermodynamic limit the 
intruder would disappear and s(e) would approach the double tangent from below. Nevertheless, 
even there, the probability oc e Ns of configurations with phase-separations are suppressed by the 
(infinitesimal small) factor e~ N ' 2 3 relative to the pure phases and the distribution remains strictly 
bimodal in the canonical ensemble. The region e\ < e < e^ of phase separation gets lost. 
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3.4 Heat can flow from cold to hot 

In figure (J3j) it is shown how a convexity of s(e) leads to a violation of Clausius' first formulation 
of the second law. 

Polls -Model, q = 1 




0.2 0.4 0.6 0.8 1.0 1.2 



e=E/N 

Figure 3: Potts model, (q = 10) in the region of phase separation. At t\ the system is in the pure 
ordered phase, at e 3 in the pure disordered phase. A little above e\ the temperature T — 1/ '(3 is 
higher than a little below e%. Combining two parts of the system: one at the energy e\ + be and at 
the temperature Ti, the other at the energy e^ — be and at the temperature T 3 < T\ will equilibrize 
with a rise of its entropy, a drop of T\ (cooling) and an energy flow (heat) from 3 — > 1: i.e.: Heat 
flows from cold to hot! Clausius formulation of the second law is violated. Evidently, this is not 
any peculiarity of gravitating systems! This is a generic situation within classical thermodynamics 
even of systems with short-range coupling and has nothing to do with long range interaction. 
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4 Negative heat capacity as signal for a phase transition of first order. 

In the previous discussion we saw the phenomenon of first-order phase-transitions is linked to the 
appearance of non-homogeneities at phase-separations, and inter-phase surfaces. This, then gives 
rise to the convexity of ^(order-parameter and the appearance of negative susceptibilities (e.g. a 
negative heat capacity). These are ubiquitous in nature from the smallest to the largest systems: 



4.1 Nuclear Physics 

A very detailed illustration of the appearance of negative heat capacities is given by D'Agostino 
et al. [9j. Here I want to remember one of the oldest experimental finding of a "back" -bending 
caloric curve in Nuclear Physics. 




Figure 4: Experimental excitation energy per nucleon e* versus apparent temperature T app for 
backward p, d, t and a together with heavy evaporation residues out of incomplete fusion of 
701 Mev 28 Si+ 100 Mo. The dotted curves give the Fermi-gas caloric curves for the level-density 
parameter a = 6 to 12. (Chbihi et al. Eur.Phys.J. A 1999) 
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4.2 Atomic clusters 

Here I show the simulation of a typical fragmentation transition of a system of 3000 sodium atoms 
interacting by realistic (many-body) forces. To compare with usual macroscopic conditions, the 
calculations were done at each energy using a volume V(E) such that the microcanonical pressure 
P = §7/ f§ — latm. The inserts above give the mass distribution at the various points. The label 
"4:1.295" means 1.295 quadrimers on average. This gives a detailed insight into what happens 
with rising excitation energy over the transition region: At the beginning (e* ~ 0.442 eV) the 
liquid sodium drop evaporates 329 single atoms and 7.876 dimers and 1.295 quadrimers on average. 
At energies e >~ leV the drop starts to fragment into several small droplets ("intermediate mass 
fragments") e.g. at point 3: 2726 monomers, 80 dimers, ~10 trimers, ~30 quadrimers and a few 
heavier ones up to 10-mers. The evaporation residue disappears. This multifragmentation finishes 
at point 4. It induces the strong backward swing of the caloric curve T(E). Above point 4 one 
has a gas of free monomers and at the beginning a few dimers. This transition scenario has a lot 
similarity with nuclear multifragmentation. It is also shown how the total interphase surface area, 
proportional to N^j^ = J2i Nf^ 3 with iVj > 2 (iVj the number of atoms in the ith cluster) stays 
roughly constant up to point 3 even though the number of fragments (Nf r = is monotonic 
rising with increasing excitation. 
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Figure 5: Cluster fragmentation 
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4.3 Stars 

Self-gravitation leads to a non-extensive potential energy oc N 2 . No thermodynamic limit exists 
for E/N and no canonical treatment makes sense. At negative total energies these systems have a 
negative heat capacity. This was for a long time considered as an absurd situation within canonical 
statistical mechanics with its thermodynamic "limit" . However, within our geometric theory this is 
just a simple example of the pseudo-Riemannian topology of the microcanonical entropy S(E, N) 
provided that high densities with their non-gravitational physics, like nuclear hydrogen burning, 
are excluded. We treated the various phases of a self-gravitating cloud of particles as function 
of the total energy and angular momentum, c.f. the quoted paper. Clearly these are the most 
important constraint in astrophysics. 

Retrieve 




£ = -0.9, 
L = 0.5 




E = -0.42, 
L = 0.5 



Contour plots and density profiles 
of a rotating, self-gravitating 
N-body system showing the 
formation of a stable double cluster 
(left) and an unstable ring (right) at 
different energies. The 
double-cluster structure illustrates 
the spontaneous breaking of 
rotational symmetry at intermediate 
energy and high angular 
momentum. 

Read the Article 



Back 



Figure 6: Phases and Phase-Separation in Rotating, Self-Gravitating Systems, Physical Review 
Letters-July 15, 2002, cover-page, by (Votyakov, Hidmi, De Martino, Gross) 



5 The second law, micro canonically 

There are many attempts to derive the second law of thermodynamics from Statistical Mechanics 
e.g. by Einstein or recently by Lieb and many others PIUEJEIE]- Lebowitz gave an excellent 
and deep discussion of the present day understanding of irreversibility [HI [T^J [T] . His "Statistical 
mechanics: A selective review of two central issues" addresses exactly to the two issues I want to 
discuss here. They are closely related but there are also deep differences as will become evident 
in the following. 

In this paper I want to emphasize an important aspect of statistical mechanics of many-body 
systems which to my opinion was not sufficiently considered up to now: Statistical Mechanics 
and with it also thermodynamics are macroscopic theories describing the average behaviour of all 
many-body systems with the same but redundant macroscopic constraint and information. This 
fact leads in a simple and straight forward manner to the desired understanding of irreversibility 
and the second law for systems obeying a time reversible microscopic dynamics. It is important to 
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Figure 7: Microcanonical phase-diagram of a cloud of self-gravitating and rotating system as 
function of the energy and angular-momentum. Outside the dashed boundaries only some sin- 
gular points were calculated. In the mixed phase the largest curvature Ai of S(E, L) is positive. 
Consequently the heat capacity or the correspondent susceptibility is negative. This is of course 
well known in astrophysics. However, the new and important point of our finding is that within 
microcanonical thermodynamics this is a generic property of all phase transitions of first order, 
independently of whether there is a short- or a long-range force that organizes the system. 



Entropy 2004, 6 



171 



deduce the second law from reversible (here Newtonian) and not from dissipative dynamics as is 
often done because just the derivation of irreversibility from fully reversible dynamics is the main 
challenge. 

The new approach that I will present here was derived from the experience that Gibbs' canonical 
statistics fails to describe properly the large and important group of non-extensive systems. These 
are systems subjected to an interaction with a range comparable to or larger than their linear 
dimension. They are strongly non- homogeneous and are either finite and have a surface, or they 
show a strong clustering like astrophysical objects, or they are split spatially in regions of different 
structures (phases) like a system at the liquid-gas phase separation. 

5.1 Measuring a macroscopic observable, the " EPS- formulation " 

A single point {<Zi(t),Pi(t)}i=i...jv in the iV-body phase space corresponds to a detailed specification 
of the system with all degrees of freedom (d.o.f) completely fixed at time t (microscopic determi- 
nation). Fixing only the total energy E of an iV-body system leaves the other (6N — l)-degrees 
of freedom unspecified. A second system with the same energy is most likely not in the same 
microscopic state as the first, it will be at another point in phase space, the other d.o.f. will be 
different. I.e. the measurement of the total energy H^, or any other macroscopic observable M, 
determines a (6N — l)-dimensional sub-manifold £ or M. in phase space 2 . (The manifold M. is 
called by Lebowitz a macrostate^^ HSJ E] which contains T M = W(M) microstates.) All points 
(the microstates) in iV-body phase space consistent with the given value of E and volume V, i.e. 
all points in the (6iV — l)-dimensional sub-manifold £(N, V) of phase space are equally consistent 
with this measurement. S(N,V) is the microcanonical ensemble. This example tells us that any 
macroscopic measurement is incomplete and defines a sub-manifold of points in phase space not 
a single point. An additional measurement of another macroscopic quantity B{q,p} reduces £ 
further to the cross-section £ n B, a (QN — 2)-dimensional subset of points in £ with the volume: 

W(B,E,N,V) = ±J^0J e 6(E-H N {q,p})5(B-B{q lP }) (8) 

If Hn{q,p} as also B{q,p} are continuous differentiable functions of their arguments, what we 
assume in the following, £ n B is closed. In the following we use W for the Riemann or Liouville 
volume of a many-fold. 

Microcanonical thermostatics gives the probability P(B, E, N, V) to find the iV-body system 
in the sub-manifold £ n B{E, N, V): 

P(B E N V) - W ( B ' E > N ' Yl - p HW(B,E,N,V)]-S(E,N,V) (q) 

This is what Krylov seems to have had in mind ^B] and what I will call the "ensemble probabilistic 
formulation of statistical mechanics (EPS) " . 

2 In this paper we denote ensembles or manifold in phase space by calligraphic letters like M. 
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Similarly thermodynamics describes the development of some macroscopic observable B{q t ,pt} 
in time of systems which were specified at an earlier time to by another macroscopic measurement 
A{q ,p }. It is related to the volume of the sub-manifold M.{t) = A(t ) n B(t) n £: 

W(A,B,E,t) = ^J (^0) 5(B-B{q t ,p t })5(A-A{q ,p })e 5(E-H{q t ,p t }), (10) 
where {qt{%, Po} , Pt{<lo, Po}} is the set of trajectories solving the Hamilton- Jacobi equations 

Pi = —--> i = l- (11) 
opi aqi 

with the initial conditions {q(t = to) = qo] p(t = t ) = p Q }. For a very large system with N ~ 10 23 
the probability to find a given value Bit), P(B(t)), is usually sharply peaked as function of B. 
Ordinary thermodynamics treats systems in the thermodynamic limit N —>■ oo and gives only 
< B(t) >. However, here we are interested to formulate the second law for "Small" systems 
i.e. we are interested in the whole distribution P(B(t)) not only in its mean value <B(t)>. 
thermodynamics does not describe the temporal development of a single system (single point in 
the 6iV-dini phase space). 

There is an important property of macroscopic measurements: Whereas the macroscopic con- 
straint A{q ,p } determines (usually) a compact region A(t ) in {qo,Po} this does not need to be 
the case at later times t ^> t : A(t) defined by A{qo{q t , Pt} , Po{<lt, Pt}} might become a fractal i.e. 
"spaghetti-like" manifold as a function of {qt,Pt} in £ at t — > oo and loose compactness. 

This can be expressed in mathematical terms: There exist series of points {a n } G A(t) which 
converge to a point a m which is not in A(t). E.g. such points aoo may have intruded from the phase 
space complimentary to A(t ). Illustrative examples for this evolution of an initially compact sub- 
manifold into a fractal set are the baker transformation discussed in this context by ref . [TTf IT8] . 
Then no macroscopic (incomplete) measurement at late time t can resolve from its immediate 
neighbors a n in phase space with distances \a n — a^l less then any arbitrary small 5. In other 
words, at the time t ^> to no macroscopic measurement with its incomplete information about 
{lt,Pt} can decide whether {qo{qt, Pt} , Po{<lt, Pt}} £ A(t ) or not. I.e. any macroscopic theory like 
thermodynamics can only deal with the closure of A(t). If necessary, the sub-manifold A(t) must 
be artificially closed to A(t) as developed further in section 15.21 Clearly, in this approach this is 
the physical origin of irreversibility. 



5.2 Fractal distributions in phase space, second law 

Here we will first describe a simple working-scheme (i.e. a sufficient method) which allows to 
deduce mathematically the second law. Later, we will show how this method is necessarily implied 
by the reduced information obtainable by macroscopic measurements. 

Let us examine the following Gedanken experiment: Suppose the probability to find our system 
at points {qt,Pt}i in phase space is uniformly distributed for times t < to over the sub-manifold 
S(N, Vi) of the iV-body phase space at energy E and spatial volume V\. At time t > t we 
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allow the system to spread over the larger volume V 2 > V% without changing its energy. If the 
system is dynamically mixing, the majority of trajectories {qt,Pt}i m phase space starting from 
points {qo,Po} with q Q C V\ at t Q will now spread over the larger volume V 2 . Of course the 
Liouvillean measure of the distribution Ai{qt,Pt} in phase space at t > to will remain the same 
(= tr[£(N, V])]) [T9*] . (The label {q C Vi} of the integral means that the positions {qo}i are 
restricted to the volume Vi, the momenta {po}± are unrestricted.) 



tr[M{q t {q ,Po},Pt{qo,Po}}}\ 
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But as already argued by Gibbs the distribution M.{qt,Pt\ will be filamented like ink in water 
and will approach any point of £(N, V2) arbitrarily close. M.{qt,Pt} becomes dense in the new, 
larger £(N, V 2 ) for times sufficiently larger than t - The closure M. becomes equal to S(N, V 2 ). 

In order to express this fact mathematically, we have to redefine Boltzmann's definition of 
entropy eq. (0J) and introduce the following fractal "measure" for integrals like J3J) or (0): 



W(E,N,t^t ) = — 



' d 3 q t d 3 p t 



N 



N\ J{q {qt < Pt}cv 1 } \ (2nh) 3 
With the transformation (done in appropriate dimension-less units) : 



e S(E - H N {q t ,p t }) 



(14) 
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&o~\ ■ ■ - da, 
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1 (dH J dH J \ 
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-dE 



l|v#|| 

W(E,N,t^>t ) 



\ 



E 



Mi. 



+ E 



dpi/ 



(15) 
(16) 

(17) 



1 



do~\ ■ ■ ■ cfcrgjv— v 



\VH\ 



N\(2irh) 3N y{»{«^}cvi} 
we replace M. by its closure M. and define now: 

W{E,N,t^>t ) ^M{E,N,t >t ) :=<G?(5(iV,V" 2 ))>*vol 4M .[A<(£;,JV,t»*o) 



(19) 



where < G(£(N, V 2 )) > is the average of 



over the (larger) manifold £(iV, V2), and 



Af!(27r^) 3JV ||Vff|. 

volfe ox [A^(-E', N,t ^> t )} is the box-counting volume of Ji4(E, N,t^$> t ) which is the same as the 
volume of M., see below. 

To obtain volb ox [M (E, N, t ^> to)] we cover the <i-dim. sub-manifold JA(t), here with d = 
(6N — 1), of the phase space by a grid with spacing 5 and count the number N$ oc 5~ d of boxes 
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Figure 8: The compact set A4(to), left side, develops into an increasingly folded "spaghetti" -like 
distribution in phase-space with rising time t , Gibbs' " ink-lines" . The right figure shows only the 
early form of the distribution. At much larger times it will become more and more fractal and 
finally dense in the new phase space. The grid illustrates the boxes of the box-counting method. 
All boxes which overlap with Ad(t) are counted in Ng in eq.(|2U|) 



of size d~ 6N , which contain points of Ai. Then we determine 

vo\ box [M(E, N, t > t )] := ljm^oS d N s [M(E, N, t > t )] 

with lim * = inf[lim*] or symbolically: 

1 / d 3 q t d 3 p t *" 



M(E,N,t^> t c 



{qo{qt,Pt}^Vi}N\ \ (27r/l) 3 

J_ r ( d 3 q t d 3 p t ^ K 

N\ J{qtCV 2 } 1 



e S(E - H 



N) 



(20) 
(21) 



e S(E - H N {q t ,p t }) 



(27ih) 3 / 

= WiEtN^^W&NM), (22) 

where ^means that this integral should be evaluated via the box-counting volume @9 here with 
d = 6N- 1. 

This is illustrated by the following figure (JEJ). With this extension of eq.(jS} Boltzmann's entropy 
(JOJ) is at time t 3> to equal to the logarithm of the larger phase space W(E, N, V2). This is the 
second law of thermodynamics. The box-counting is also used in the definition of the Kolmogorov 
entropy, the average rate of entropy gain [213 EI]- Of course still at to M.{to) = M.{to) = Vi): 



M{E,N,t ) 



'd 3 qo d 3 po 



N 



\ qo cv l} N\ \ (2vr^)3 ; 

J_ / d 3 q d 3 p Q \ N 
{qo cv l} N\ { (27rh) 3 J 
W(E,N,V X ). 



e 5(E - H N ) 
e 6(E - H N ) 



(23) 



(24) 
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The box-counting volume is analogous to the standard method to determine the fractal dimen- 
sion of a set of points [20J by the box-counting dimension: 

dhWMfl. t » t,)] := lim^o '" NllM(E ; n N s ' >> k)] (25) 

Like the box-counting dimension, volb ox has the peculiarity that it is equal to the volume of 
the smallest closed covering set. E.g.: The box-counting volume of the set of rational numbers 
{Q} between and 1, is vo\b ox {Q} = 1, and thus equal to the measure of the real numbers , c.f. 
Falconer [20] section 3.1. This is the reason why volb ox is not a measure in its strict mathematical 
sense because then we should have 



vol 



box 



E (Mi) 

iC{Q} 



E vo\ box [Mi] =0, (26) 

iC{Q} 



therefore the quotation marks for the box-counting "measure" c.f. appendix [7| 

Coming back to the the end of section (|5.1j) . the volume W(A, B, ■ ■ ■ , t) of the relevant ensemble, 
the closure M. (t) must be "measured" by something like the box-counting "measure" (|20I21|) with 
the box-counting integral ij^ which must replace the integral in eq.(J5J). Due to the fact that the 
box-counting volume is equal to the volume of the smallest closed covering set, the new, extended, 
definition of the phase-space integral eq.(|2*Tj) is for compact sets like the equilibrium distribution 
8 identical to the old one eq.(0) and nothing changes for equilibrium statistics. Therefore, one 
can simply replace the old Boltzmann-definition of the number of complexions and with it of the 
entropy by the new one (J21j) . 



5.3 Conclusion of the discussion of the second law 

Macroscopic measurements M determine only a very few of all 6N d.o.f. Any macroscopic theory 
like thermodynamics deals with the volumes M of the corresponding closed sub-manifolds M. in 
the 6iV-dim. phase space not with single points. The averaging over ensembles or finite sub- 
manifolds in phase space becomes especially important for the microcanonical ensemble of a finite 
system. 

Because of this necessarily coarsed and redundant information, macroscopic measurements, and 
with it also macroscopic theories are unable to distinguish fractal sets Ai from their closures M.. 
Therefore, I make the conjecture: the proper manifolds determined by a macroscopic theory like 
thermodynamics are the closed M.. However, an initially closed subset of points at time to does 
not necessarily evolve again into a closed subset at t ^> t . I.e. the closure operation and the 
t — > oo limit do not commute, and the macroscopic dynamics becomes thus irreversible. 

Here is the origin of the misunderstanding by the famous reversibility paradoxes which were 
invented by Loschmidt [22] and Zermelo [231 E3| and which bothered Boltzmann so much [213 EHj • 
These paradoxes address to trajectories of single points in the iV-body phase space which must 
return after Poincarre's recurrence time or which must run backwards if all momenta are exactly 
reversed. Therefore, Loschmidt and Zermelo concluded that the entropy should decrease as well 
as it was increasing before. The specification of a single point demands of course a microscopic 



Entropy 2004, 6 



176 



exact specification of all 6N degrees of freedom not a determination of a few macroscopic degrees 
of freedom only. No entropy is denned for a single point. Moreover, it is highly unlikely that 
all points in the micro-ensemble have commensurate recurrence times so that they can return 
simultaneously to their initial positions. Once the manifold has spread over the larger phase space 
it will never return. 

This way various non-trivial limiting processes are avoided. Neither does one invoke the ther- 
modynamic limit of a homogeneous system with infinitely many particles nor does one rely on 
the ergodic hypothesis of the equivalence of (very long) time averages and ensemble averages. 
The use of ensemble averages is justified directly by the very nature of macroscopic (incomplete) 
measurements. Coarse-graining appears as natural consequence of this. The box-counting method 
mirrors the averaging over the overwhelming number of non-determined degrees of freedom. Of 
course, a fully consistent theory must use this averaging explicitly. Then one would not depend 
on the order of the limits lim^o lim^oo as it was tacitly assumed here. Presumably, the rise 
of the entropy can then be already seen at finite times when the fractality of the distribution in 
phase space is not yet fully developed. The coarse-graining is no more a mathematical ad hoc 
assumption. Moreover the second law is in the EPS-formulation of statistical mechanics not linked 
to the thermodynamic limit as was thought up to now [T4"l fT3| . 

6 Final conclusion 

Entropy has a simple and elementary definition by the area e s<yE,N '' "- 1 of the microcanonical ensem- 
ble in the 6iV dim. phase space. Canonical ensembles are not equivalent to the micro-ensemble 
in the most interesting situations: 

1. at phase-separation ( >-heat engines !), one gets inhomgeneities, and a negative heat ca- 
pacity or some other negative susceptibility, 

2. Heat can flow from cold to hot. 

3. phase transitions can be localized sharply and unambiguously in small classical or quantum 
systems, there is no need for finite size scaling to identify the transition. 

4. also really large self-gravitating systems can now be addressed. 

Entropy rises during the approach to equilibrium, AS > 0, also for small mixing systems, i.e. the 
second law is valid even for small systems [2J El • 

With this geometric foundation thermo-statistics applies not only to extensive systems but also 
to non-extensive ones which have no thermodynamic limit. 

7 Appendix 

In the mathematical theory of fractals [201 one usually uses the Hausdorff measure or the Hausdorff 
dimension of the fractal |21j . This, however, would be wrong in Statistical Mechanics. Here I 
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want to point out the difference between the box-counting "measure" and the proper Hausdorff 
measure of a manifold of points in phase space. Without going into too much mathematical 
details we can make this clear again with the same example as above: The Hausdorff measure 
of the rational numbers G [0, 1] is 0, whereas the Hausdorff measure of the real numbers G [0, 1] 
is 1. Therefore, the Hausdorff measure of a set is a proper measure. The Hausdorff measure of 
the fractal distribution in phase space M.{t — > oo) is the same as that of Ai(to), W(E, N, V\). 
Measured by the Hausdorff measure the phase space volume of the fractal distribution M.{t — > oo) 
is conserved and Liouville's theorem applies. This would demand that thermodynamics could 
distinguish between any point inside the fractal from any point outside of it independently how 
close it is. This, however, is impossible for any macroscopic theory that can only address the 
redundant macroscopic information where all unobserved degrees of freedom are averaged over. 
That is the deep reason why the box-counting "measure" must be taken and where irreversibility 
comes from. 
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